On New Methods of Dynamic Ensemble Selection Based on Randomized Reference Classifier

In the paper two dynamic ensemble selection (DES) systems are proposed. Both systems are based on a probabilistic model and utilize the concept of Randomized Reference Classifier (RRC) to determine the competence function of base classifiers. In the first system in the selection procedure of base classifiers the dynamic threshold of competence is applied. In the second DES system, selected classifiers are combined using weighted majority voting rule with continuous-valued outputs, where the weights are equal to the class-dependent competences. The performance of proposed MCSs were tested and compared against DES system with better-than-random selection rule using eleven databases taken from the UCI Machine Learning Repository. The experimental results clearly show the effectiveness of the proposed methods.